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PURPOSE: To convert a subject image all at once into the data of 
different forms for each part of the image when the image data of a 
certain form is converted into the data of another form. 
CONSTITUTION: The image data stored in an IMEM 4 are displayed 
on a CRT 1 3. An operator designates a part that is converted into a 
character code after recognition of a character and a part that is 
converted into the graphic data based on the displayed image data. 
When the start of conversion is instructed, those designated parts are 
converted into each designated form and stored in an idle area of a 
PMEM 5 or the IMEM 4. When the conversion is completed, the 
converted data are read out from the storage destination and 
synthesized with the recomposed image data. Then the synthetic data 
are displayed on the CRT 13. v J£ 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 

DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the image processing system which reads and carries 

out data conversion of the image. 

[0002] 

[Description of the Prior Art] If it was in the equipment which changes one image data into the data of a 
different class like graphic data and alphabetic data conventionally, each conversion function existed 
independently like the function to change image data into graphic data, and the function to change image 
data into alphabetic data. For this reason, in telling graphic data that a portion with one image changes 
another portion into alphabetic data, in order to obtain graphic data first, an image is read from a scanner 
etc., and after editing the read image and removing an unnecessary portion, it changes into graphic data, 
and mem orizes the obtaine d graphic data temporarily. Next, in order to obtain alphabetic data, reading 
repair ancTthe read imageare again edited from a scanner etc., and said image data is changed into 
alphabetic data. Thus, the original image has been reproduced only after performing each conversion 
independently, reproducing image data from the obtained data andj g-compound ingjj^ 
[0003] 

[Problem(s) to be Solved by the Invention] However, in the equipment mentioned above, in order to 
read image data in order to change a certain portion in one image data into alphabetic data to change a 
certain another portion into graphic data at alphabetic data, and to change into graphic data, the same 
image data must be reread again. Thus, the trouble of [ whenever the class of conversion changes, it is 
necessary to reread an image, although images are few whenever the trouble that processing becomes 
complicated, and the input unit for reading image data read into a ****** case with a scanner, in order 
to change, exact conversion carries out, and ]****** is ******. 

[0004] Moreover, the trouble that image edit etc. must be performed to the image data whenever it reads 
since only a required field is transformed to graphic data or alphabetic data, and there is nothing in the 
equipment mentioned above in addition to the time and effort of rereading image data repeatedly if it is 

?fc $jc £|c j|c j ^ 5|c s|c s|c s|c s|( s|c 

[0005] This invention was made in view of the above-mentioned conventional example, can perform at 
once different conversion for every portion specified to one image data, and aims at offering the image 
processing system which can reconfigurate the original image easily from the data of a different class 
changed and acquired. 
[0006] 

[Means for Solving the Problem] In order to attain the above-mentioned purpose, an image processing 
system of this invention consists of the following configurations. 

[0007] The 1st assignment means which specifies the format at the time of being the image processing 
system which changes and stores image data in other format, and changing image data into other data 
format, The 2nd assignment means which specifies a field changed into format specified with this 
assignment means in image data as 1 set of formal assignment means It has a conversion means to 
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change into data format which had image data in a field specified by two or more sets of formal 
assignment means which are two or more format that data format specified with said 1st assignment 
means differs, and said formal assignment means specified. 
[0008] 

[Function] The image processing system of this invention divides one image data into some portions by 
the above-mentioned configuration, and it changes into the data of different format for every portion of 
the. Moreover, the changed data can be returned to image data and they can be compounded. 
[0009] 

[Example] the following and an accompanying drawing -- therefore, the example of this invention is 
explained to details. In addition, if the function of this invention is performed, it cannot be 
overemphasized in the system to which processing is performed also for ****** through networks, such 
as LAN, by the system which ****** also becomes from two or more devices by the device of a simple 
substance that this invention is applied also for ******. 

[0010] [Example 1] drawing 1 is system block drawing of the image processing system which is the 
example of this invention. 1 is a system bus and each configuration block to be explained from now on 
is connected to this system bus. 2 is CPU (Centrtal Processing Uint). 3 is memory (Following PMEM is 
called) which stores a program or a text. Selection/reading of the progranf for edit^processing are 
suitably done from a hard disk 14 at PMEM3, and it is performed by CPU2. Moreover, the data inputted 
from the keyboard 9 is stored in PMEM3 as code information. The graphic data changed from image 
data are also stored in PMEM, After [ VRAM /ll] being developed by IMEM of 4, it is developed 
upwards, and the image data into which 4 is a printer and image memory (Following IMEM is called) 
and 5 were read [ 4 / an image I/O control unit and 7 ] for an image scanner and 6 from the image 
scanner 5 is displayed on CRT 13. Moreover, a printing image is outputted to a printer 7 by^ ontrol of 
image I/O control unit 6, after hein ^ developed hy IMEM4 as bit map data. 8 is the input-controTsectrdh 
and the input unit of keyboard 9 and mouse 10 grade is connected. An operator performs the operating 
command of a system etc. by operating this keyboard 9. Moreover, the mouse 10 is for carrying out 
selection / processing directions of the image information on CRT13, and in this example, although it is 
using the mouse, it should just be a pointing device. The mouse cursor on CRT13 is moved in the 
direction of X-Y with a mouse 10 at arbitration, and selection and edit of selection and the graphic data 
of the selection and the image data of a menu are performed. As for video image memory (VRAM is 
called hereafter) and 12, 1 1 is [ a display-output control section and 13 ] CRT. The data displayed on 
CRT13 is developed by VRAM1 1 as bit map data. For example, if it is graphic data, the graphic form 
pattern corresponding to its location and attribute information is developed by VRAM as an image. 
Moreover, it is possible to generate direct cursor to the data of VRAM by software control, and to 
display. 14 is an external storage control section and a disk for data files in 15-16, 15 is a hard disk 
(Following HD is called), and 16 is a floppy disk (Following FD is called). 

[001 1] Drawing. 2 to drawing. 7 is drawing explaining the activity of the image processing system of this 
example. 

[0012] It is drawing having shown the condition of drawing 2 having read the image from the image 
scanner 5, and having displayed on CRT13, and 21 is display image data. 

[0013] Drawing 3 is drawing which specified the field to change into graphic data within the display 
image data 21 . The field 34 made by moving pushing the left carbon button of a mouse to the 
termination location 33 of a field to change the cursor (for a mouse cursor to be called below) 3 1 which 
shows the location on CRT13 of a mouse 10 from the starting position 32 of a field to change turns into 
a conversion field. 

[0014] Drawing 4 is drawing having shown the screen for setting up the conditions at the time of 
changing the image data in the above-mentioned conversion field 34 into graphic data. 41 is a graphic 
form conversion conditioning window, and only when a numeric character is inputted into the condition 
input area 42 in a window 41 from a keyboard 9 and the length of the sequence of points which image 
data follows is said beyond input numeric character, it is changed into graphic data. When inputting 
nothing, all the image data in a graphic form conversion field is changed into graphic data. The 
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conditions of graphic form conversion will be determined by specifying a confirmation button 43. 
[0015] Drawing S is drawing having shown concretely the conditions which change continuous 
sequence of points into graphic data. B-C-D-E is the branch point among drawing, and the sequence of 
points which continue at this point go out. That is, in this Fig., continuous sequence of points (it is 
hereafter called a segment) are nine of AB-BC-CD-DE-EF-BG-CH-DI-EJ, and these segments are 
changed into the graphic data which became independent respectively, for example, when the branch 
point B is observed, it is ****** to the conditions which the length of Segment BG set up by drawing 4 
-- and if the conditions which the length of Segments AB or BC set up by drawing 4 also as ** are 
suited, it will be changed into a graphic form noting that the intermediary **** segment BG fulfills [ the 
rope ] conditions to it. 

[0016] Drawing 6 is drawing which specified the field to change into alphabetic data within the display 
image data 21, and is specified using a mouse cursor 3 1 with the same specification method as 
explanation by drawing 3 . Thus, the specified field is 61-62-63-64, and it is shown by the dashed line in 
order to distinguish from the graphic form conversion field 34. Although the transliteration field exists 
inside a graphic form conversion field in drawing 6 , this is because it came inside on account of 
explanation, and ****** does not matter in fact where in image data, either. 

[0017] Drawing 7. is drawing having shown the condition after changing respectively the graphic form 
conversion field 34 and the transliteration field 61-62-63-64 in image data into graphic data and 
alphabetic data. The inside 71-72-73-74-75 of drawing is the field changed into alphabetic data, and is 
changed into graphic data except it. Moreover, in case the image which is not shown in drawing 7 while 
being displayed by the image data of drawing 6 is changed into graphic data, it is changed into graphic 
data according to the aforementioned graphic form conversion conditions, and it is inside **** image 
data and such image data is eliminated white. 

[0018] Next, actuation of the image processing system of an example is explained using a flow chart. 
[0019] Drawing 8 , and drawing 9 and drawing 10 are the flow charts explaining actuation of this 
example, and show the procedure of the processing performed by CPU2. The flow chart of drawi ng 8 
explains actuation of the conversion block definition to image data until it performs graphic form 
conversion and a transliteration, the flow chart of drawing 9 performs the processing process of graphic 
form conversion, the flow chart of drawjng.lO actually performs a transliteration, and actuation until it 
displays the result on CRT 13 is explained. Although these are divided for convenience, they are a series 
of processings. Moreover, what was illustrated is only a portion in connection with transform 
processing, and the portion which is not related is excluded. 
[0020] An operator makes a graphic form read from an image scanner 5 first. 
[0021] In step SI, the image data of the image read from the image scanner 5 is stored in IMEM4, it, 
develops t o WAM11 and image data is dis plax^onXBXLi, 

[0022] NexTTtn-ortter to specify a graphic form conversion field, an operator uses a mouse 10 and 
chooses graphic form conversion criteria specification from a menu. If a menu is chosen, it will test 
about selected contents. 

[0023] It first tests whether in step S2, the selected menu is conversion in a graphic form, or it is 
conversion to an alphabetic character. If it is conversion in a graphic form, the target field will be made 
to specify at step S3. That is, if an operator starts the depression of the left carbon button of a mouse in 
the arbitration location in image data, and moves a mouse with the condition of a depression, and the 
above-mentioned depression starting position and a current mouse cursor location are made into the 
diagonal line, a rectangle will be drawn as a continuous line. The field in this rectangle turns into a 
graphic-data conversion field, and this field is decided by ending the depression of the left carbon button 
of a mouse. ****** does not care about a graphic form conversion field with plurality, either. 
[0024] Step S4 is a st ep into which th e^conversii m conditions to graphic data are made to input to the 
ootid iti on i ng~wi ndim^s h o wn in drawing 4 ) displayed when the above-mentioned graphic form 
-conversion field is specified, an operator — directions of a window — therefore, conditions are inputted 
and graphic form conversion conditions are decided by specifying a check, this conversion conditioning 
window — even [ a graphic form conversion field ] - ******** „ since the first half of the 1st inning is 
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shown, ******** conditions can be set up to each conversion field. 

[0025] After one conditioning finishes, an item is made to choose from a menu again. The contents of 
selection are tested (step S7, S2), and if it is a setup of the conversion conditions to an alphabetic 
character, an object domain will be made to specify at step S5. That is, if an operator starts the 
depression of the left carbon button of a mouse in the arbitration location in image data and moves a 
mouse with the condition of a depression, the rectangle which makes the diagonal line a depression 
starting position and a current mouse cursor location will be drawn with a dashed line. Because it 
enabled it to distinguish from a graphic form conversion field, it is drawn with a dashed line. The field 
in this rectangle turns into an alphabetic character data-conversion field, and this field is decided by 
ending the depression of the left carbon button of a mouse. ****** does not care about a transliteration 
field with plurality, either. 

[0026] Step S6 is a step into which the discernment conditions of whether the alphabetic character in the 
field specified to the character recognition condition decision window displayed when a transliteration 
field is specified recognizes lateral writing, columnar writing, and a space, and alphabetic data are made 
to input. Character recog nition cond itions ar e decided by an intermediary operator's inputting 
recognition conditions, although itwas made directions of a window, and specifying a check, this 
character recognition conditioning window even [ a conversion field ] -- ******** — since the first 
half of the 1st inning is shown, different character recognition conditions to each conversion field can be 
set up. 

[0027] After assignment of a graphic form conversion field and a transliteration field is completed, an 
item is made to choose from a menu. If the contents of selection are tested (step S7) and transform- 
processing initiation is chosen, transform processing will be started to the specified conversion field. 
The processing internally performed first in the case of conversion is decision whether there is any 
transliteration field, and, in other words, is whether the operator performed step S5 and 6. This step is 
step S8. 

[0028] In step S8, when it is judged that there is no transliteration field, step S9 and step S 10 are not 
performed, but progresses to graphic form transform processing as it is. 

[0029] In step S7, when it is judged that there is a transliteration field, it progresses to the following step 
S9, the buffer for transliterations is newly taken to the field which **ed in PMEM3 or IMEM4, and the 
image data in a transliteration field is copied there. Even a transliteration field receives and this one copy 
buffer exists. 

[0030] In step S10, the transliteration field in image data is eliminated white after copy termination, the 
semantics which prevents this incorrect-recognizing the image data in a transliteration field in a graphic 
form in the case of graphic form conversion, and the semantics which makes speed of graphic form 
conversion quick - with, it is. 

[0031] As mentioned above, if a setup of conditions is completed, actual graphic form conversion and 
transliteration processing will be started from step SI 1. 
[0032] The flow chart of drawing 9 is explained. 

[0033] It tests whether at step SI 1, there is any conversion field specified as the graphic form for 
conversion first. Supposing it is, in step S12, thi nning of the imaR gjiataia-a-gcap hic form conversio n 
field will be performed. T hinning is processing which uses image data as the line drawi ng data ofj ^dot 
Wre kh - of face. A fthougtTfKe algorithm of thinning is us ed^as^arocgssingot the pr^o^^xxigrf^r^gv^^^erY 
oln-ecugnition o ^grapfiftrfbrm4t^ ^ processing systemoftFus example^^ technique 

iyTw^metht5gTand iti s satisfa ctory even if ltjias aHoptecUeclmique^h^ s . 

[0034] AKerThinirmg^fthe image data in a graphic form conversion field is completed, in step S 13, the 
inside of a graphic form conversion field is scanned, and 1 set of sequence of points which image data 
followed are extracted. 

[0035] Next, in step SI 4, the continuous sequence of points extracted at step S 13 judge whether the 
graphic form conversion conditions set up by step S4 are suited. When it is judged that conditions are 
fulfilled here, if it is not progressing and filling to the following step SI 5, the sequence of points by 
which return and a degree followed step S13 are extracted. 
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[0036] If conditions are filled with step S14, in step S15, the point (the salient point is called hereafter) 
used as an angle will be extracted about the continuous sequence of points extracted at step SI 3. The 
extract of this salient point is **** intermediary **** by asking for the curvature of sequence of points 
in this example. However, ****** is also satisfactory by any technique other than this. 
[0037] In step S16, in a straight line, when one side of 2 sets of sequence of points divided on both sides 
of the salient point has recognized it as intermediary **** **** in the configuration of sequence of 
points so that it may say that another side is a curve, it divides the above-mentioned sequence of points 
which carry out continuation in the salient point. 

[0038] Furthermore, in step SI 7, to the sequence of points recognized to be a curve, polygonal -line 
approximation is carried out first and a curve is approximated for the folding point which was able to be 
found by the approximation as a control point of a spline curve. Of course, as for the curve to 
approximate, a problem does not have ****** in any way not at a spline curve but at a Bezier curve etc, 
either. 

[0039] At step SI 8, conversion to actual graphic data is performed based on the contents of recognition 
to step SI 7. It is changed into three sorts of graphic data of a straight line, the pol ygonal line, and a . 
qurve in this exarnple Let the app roximation function with which the polygonartIni3 .flSSfl s alongZbotb 
enHTamhgg cn toj>most vertices, and a curve passes along rppr^Qftntat^ p points (control point) and those 
poin ts twn"pmnts to which a Straight line i s located in the both ends he graphic data Th fi nhtainpH 
graphic data are stored in tflfl frfip arpa ^fPMFM^ p r TMFM4, Things other than the three above- 
mentioned kind may be added as a class of graphic data changed. 

[0040] In step SI 9, when it judges whether all the data that carried out thinning was changed into 
graphic data and all are not changed yet, it repeats from extract processing of the sequence of points of 
step S13. 

[0041] Conversion to graphic data is completed above. Next, explanation about transliteration 
processing of drawing 10 is performed. 

[0042] It tests whether the field which should be carried out a transliteration is specified as a step of the 
beginning of character recognition (step S20). 

[0043] If it is, alphabetic character end processing will be performed to the image data in the buffer 
copied by step S9 in step S21. 

[0044] Next, in step S22, recognition processing of an alphabetic character is performed about the image 
by which the alphabetic character end was carried out. 

[0045] In step S23, word collating with the result in step S22 which carried out character recognition, 
and a word dictionary is performed. 

[0046] In step S24, it changes into alphabetic character (code) data based on the character recognition 
result in step S22. The rhang^d data of a result is stored in the free area of PMEM3 or IME M4. 
[0047] In step S25, it judges whether transform processing to all transliteration images was completed. 
When it is judged that it has not ended yet, the processing from step S21 is repeated until conversion to a 
character code ends about all the candidates for conversion. When it is judged that graphic form 
transform processing was completed at step SI 9, and transliteration processing was completed at step 
S25, it progresses to step S26. At this step S26, from the graphic data after conversion, an image is 
reconfigurated, the4 iit map d ata f or a display is created, and it stores in VRAM 1 1 . Tlusimage is 
displayed on CRT1 3~ " " " 

[0048] In step S27, alphabetic data [ finishing / a transliteration ] is slushed into a void ****** field in 
the field S10 which specified the transliteration at step S5, i.e., a step, inside, and the result is displayed 
on CRT1 3. Ttiisj s layin g t he image of the alp habetic character obt ained from character code data on top 

s^Jix^iXj mp-deitdi prV RAM44 , creating new ili rage data toitr and~His^ — ^ 

[0049] In the above procedure, the graphic data and alphabetic data which were obtained from the image 
of a basis can be obtained, and an image can be reproduced from the obtained data. Moreover, it is lost 
by specifying conditions at the time of conversion that an alphabetic character image is easily changed 
into graphic data, and it is effective in it being few compared with the case where the amount of 
information of graphic data also changes an alphabetic character image into graphic data, and ending. 
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Moreover, there is also an effect that transform processing increases the efficiency, by performing 

conversion to graphic data, and conversion to alphabetic data to coincidence. 

[0050] 

[Other Example(s)] 

In the [example 2] example 1, easy conditioning of changing only the sequence of points followed more 
than the specified length by setting it as the main purposes to prevent conversion to the graphic data of 
alphabetic character image data into graphic data is carried out. If the sequence of points which continue 
in the field of one character obtained from an assignment point size by adding to this a condition [ the 
point size of an alphabetic character ] are settled, it will become possible for the conversion to graphic 
data not to perform ****** by the data more than the length which the operator specified [ continuous 
sequence of points ], either. By carrying out like this, alphabetic data and graphic data carving is 
clarified further. 

[0051] Moreover, it is also possible to changeJn asshmmentof the poi jit size in the above-mentioned 
explanation, and to specify length (for the number of dots or mm to be sufficient) in every direction 
directly. For example, it is good for making it find the length in every direction for one character 
automatically by specifying a field which surrounds one suitable character in display image data with a 
mouse 10, and drawing a straight line with a mouse also considering the length which can be found from 
the drawn straight line therefore (however, this straight line is not related to graphic data) as conditions. 
[0052] Moreover, although he is trying to change into graphic data the sequence of points followed more 
than the length specified by an operator, an operator may enable it to specify the "above" and the 
"following" in an example 1. It becomes possible by therefore specifying the "following" as this to 
transform only fine image data to graphic data. This is the same also in assignment of the point size 
described above. 

[0053] Although a series of actuation is performed by using pointing devices, such as a mouse, you may 
enable it to operate it from a keyboard in an example 1. 

[0054] Moreover, in an example 1, ****** does not care about an image entry of data with the image 
data it was remembered to be by external storage even from other input units if only intermediary **** 
**** from an image scanner could incorporate image data, either. 

[0055] Moreover, although the block definition of the image data changed into graphic data and graphic 
data is performed in the rectangle field, ****** is also good in closed regions, such as a circle, an 
ellipse, and a polygon. 

[0056] Although the own check of graphic data has eliminated the image data before conversion so that 
easily in case the graphic data after conversion display, it may leave image data as it is, and an operator 
may enable it to perform display and elimination to the timing of arbitration by establishing the change 
means of image data display elimination in an example 1. 

[0057] It was what divides one image into the portion of an alphabetic character, and the portion of a 
graphic form, and changes it into the data format of an alphabetic character and a graphic form with the 
[example 3] example 1 and the equipment of 2, respectively . However, coji ygrskm is not wfrarwas" 
restricted t o these two s orts, and other conversion may bgjnix^iL 

t5058]Tnaddition to conversion to the alphabetic character and graphic data of an example 1, 
conversion of no changing is performed, namely, image data -- a field as it is is made to specify the fi eld 
^ surrounded with the dashed line i n drawing 11 — image data -- it ist he portion specified that it remain s'" 
as jj: is . Thus, if 3rd conversion is carried out, it is neCessaiy to add one more sort to the menu of a setup 
of conversion conditions first. That is, the processing which makes ajio n-changed j ield spec ify together 
with steps S3 -S6 of drawing 8 is added. Moreover, if the existence ofanon-changed field is tested after 
taking out aira nslitciu t i u ii fi e ld irt -step 10,lhe field will be taken out, it will evacuate to the empty 
portion of memory, and the non-changed field 1 1 1 will be eliminated from image data. Since it did not 
change, there is especially no processing in connection with conversion. In case an image is reproduced, 
after composition of the image reproduced from graphic data and the image reproduced from alphabetic 
data finishes, the field 1 1 1 saved as a non-changed field is compounded further, bit map data is made, 
and it displays on CRT13. 
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[0059] Thus, it can process with the equipment which mixes three kinds of conversion together, carries 

out, and reconfigurates an image from the changed data as well as an example 1 . 

[0060] In addition, even if it applies this invention to the system which consists of two or more devices, 

it may be applied to the equipment which consists of one device. Moreover, it cannot be overemphasized 

that it can apply also when therefore attained by that this invention supplies a program to a system or 

equipment. 

[0061] 

[Effect of the Invention] As explained above, the image processing system concerning this invention can 
perform at once different conversion for every portion specified to one image data, and can 
reconfigurate the original image easily from the data of a different class changed and acquired. 

[Translation done.] 



http://www4.ipdljpo.go.jp/cgi-bin/tran_web_cgi_ejje 3/16/04 



